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Appl. No. 10/810.680 

AmdL dated June 29, 2006 

Reply to Office Action of January 26, 2006 

Amendments to the Claims 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. 

Applicant notes that claims 1 , 3, 4, 5, 6, 8, 9, 12, 13, 1 4, 1 6, 22, 24, 26, 29. 30, 
31 , 32, 34, 35, 36, 37, 38, 39, 40, 43 and 44 are currently amended, claims 2, 10, 
1 1 , 15, 23, 25, 27 and 28 are original, claims7, 17-21 , 33, 41 and 42 are 
cancelled and claims 45 to 80 are new. 
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Reply to Office Action of January 26, 2006 

In the Claims: 

Amend the claims as follows: 

Listing gt Claims 

1 . (Currently amended) A method for creating a multidimensional visual 
representation of a group of data elements having integrated temporal and 
spatial properties, the data elements being included in the visual representation 
as a corresponding plurality of v isual elements, the data olomonts of tho group 
l lnkod by at l oaet ono associatio n the method comprising the steps of: 

assembling tho group of data olomonto ucing tho at loast ono association; 

generating a spatial domain of the visual representation to include a 
reference surface for providing a spatial reference frame having at least two 
spatial dimensions, the reference surface for relating a first visual element atlllfi 
plurality of visual elements representing a first data element of the group to a first 
location of interest in the spatial reference frame and relating a second visual 
element of the plurality of visual elements representing a second data element of 
the group to a second location of interest in the spatial reference frame; 

generating a temporal domain of the visual representation operatively 
coupled to the spatial domain, the temporal domain for providing a common 
temporal reference frame for the locations of interest, the temporal domain 
including a first time track coupled to the first location of interest and a second 
time track coupled to the second location of interest, the first visual element 
positioned on the first time track and the second visual element positioned on the 
second time track, each of the time tracks extending with respect to the reference 
surface and c onfigured for visually representing a respective temporal sequence 
of a plurality of the data elements at each of the locations of interest of tho 
rof e reno e eurfaco ; 

positioning a respective instant of focus at the intersection region between 
each of the time trac ks and the reference surface at the respec tive locations of 
Interest, the Instant of foci being used for visually distinguishing a range of past 
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time in the temporal domain preceding the Instant of foci and a range of future 
time in the temporal domain after the instant of foci, each of the instant of foci 
configured for synchronous repositioning along their respective one of the time 
tracks : and 

assigning a connection visual element in the visual representation 
between the first visual element and the second visual element, the connection 
visual element for representing-a an dictr i birtod association distributed in at least 
one of the domains between the first visual element and the second visual 
element; 

wherein the visual representation is displayed on a user interface for 
subsequent interaction with user events. 

2. (original) The method of claim 1 , wherein the visual representation of the 
group of data elements is selected from the group comprising; a concurrent time 
and geographic context and a concurrent time and diagrammatic context. 

3. (Currently amended) The method of claim 2. wherein the diagrammatic 
context inPlWtiftS fl plurality Pf OPtiES Pf ? jfeflnfrti prftffess, s^ch that ftpe of the 

nodes is ppsitipn^ f j^t iwaflpn Qf interest an? e rerand png pf the nptfes 

ig PQSitlQned at frg second 'PCatiPn Of interest furthor oompricing tho ctop of 
conf i guring th e r e f e renc e surface for providing an I n s tant of focu s I n tho tempora l 
r e f e ronoo frame for at loaot oomo of tho temporal and spatia l proportios of tho 
group of data o l omonto, tho inotant of foouo oouplod to tho l ooationo of i nterest of 
tho roforonco curfaoo. tho i nstant of focuc ootootod by tho user e vents, 

4. (Currently amended) The method of claim 3 further comprising the step of 
conf i gur i ng specifying p time range qf the temporal reference frame for provid i ng 
a timo rang e selected from the group comprising: a the e ast range of past time of 
the temporal sequence preceding the Instant of focus; and a fliefcrtwe range of 
future time of the temporal sequence after the instant of focus. 
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5. (Currently amended) The method of claim 4J_ further comprising the step 
of intersecting each of the fret time tracks through the ftet their respective 
location of interest such that the past ranges of the first time tracks extends from 
one side of the reference surface and the future ranges of the fret time tracks 
extends from the other side of the reference surfac o^ tho instant of focus located 
on tho first timo track at the intoroootion point between tho first t i mo track and the 



6. (Currently amended) The method of claim 5 further comprising the step of 
arranging a-tifstthe p lurality of the visual elements along the flrst time tracks 
according to the times at which the corresponding v isual data elements occurred 
in the temporal reference fram e, at least one of the plurality of the visual 
elements being independent and as such being not related to either of the first 
antf second yi$Ufl» fllgmgnfo 

7. (cancelled) 

8. (Currently amended) The method of claim 7 ^further comprising the step 
of arranging a second fljaplurality of the visual elements along the eeeend time 
tracks according to the times at which the corresponding data visual elements 
occurred in the temporal reference fram e, the type of the data elements selected 
from the orouo comprising: entities: events: locations: and associations. 

9. (Currently amended) The method of claim 6, wherein the location in the 
temporal reference frame of each of the plurality of visual elements on the time 
tracks is proportional to the distance from the instant of foeus foci associated with 
the reference surface , the type of the visual elements selected from the group 
comprising: entities: events: locations: and associations, 

1 0. (original) The method of claim 9, wherein the time tracks are represented 
as timelines in the visual representation. 
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1 1 . (original) The method of claim 10, wherein the temporal reference frame 
has a scale selected from the group comprising linear and logarithmic. 

1 2. (Currently amended) The method of claim 2 further comprising the step of 
maintaining an orientation of the time tracks with respect to the reference surface 
such that changes in the attitudo viewing orientation of the reference surface in 
response to the user events results in a corresponding change In the viewing 
orientation of the time tracks. 

1 3. (Currently amended) The method of claim 12, wherein the orientation 
angle between the time tracks and the reference surface is 90 degrees. 

1 4. (Currently amended) The method of claim 2 further comprising the step of 
maintaining an orientation of the time tracks with respect to the reference surface 
such that changes in the viewing orientation a ttitude of the reference surface in 
response to the user events does not result in a corresponding change in the 
viewing o rientation of the time tracks such that the time tracks are maintained In 
a vertical orientatipn. 

15. (original) The method of claim 1 4, wherein the orientation of the time 
tracks is such that the length of the time tracks is maximized as perceived by a 
user of the user interface. 

1 6. (Currently amended) The method of claim 2 further comprising the step of 
overlapping a time chart on the first time track and on the second time track, the 
time chart having a time axis and a spatial axis for representing the temporal 
reference frame and at least one of the spatial dimensions respectivel y, such that 
visual reference elements between the time axis and the time tracks are 
maintained as a new spatial orientation of the spatial reference frame is selected 
and the time tracks in the time chart remain continuously connected across the 
time chart and the spatial reference frame so that the time tracks in the time chart 
are repositioned to comespprti 19 frg new spatial orientation. 
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17. (cancelled) 

18. (cancelled) 

19. (cancelled) 

20. (cancelled) 

21. (cancelled) 

22. (Currently amended) The method of claim 2, wherein types of the data 
elements are selected from the group comprising; entity, location, association. 
and event. 

23. (original) The method of claim 22, wherein the event data element type 
represents an action taking place at a particular one of the locations of interest In 
the spatial reference frame and at a particular time in the temporal reference 
frame. 

24. (Currently amended) The method of claim 23, wherein the event data 
element type has data properties and display properties selected from the group 
comprising; a short text label, description, location, start-time, end-time, general 
event type, icon reference, visual layer settings, priority, status, user comment, 
certainty value, source of information, default -hand user-set color, reference 
document and reference photograph. 

25. (original) The method of claim 22, wherein the entity data element type 
represents an actor Involved in a selected event. 

26. (Currently amended) The method of claim 25, wherein the entity data 

element type has data properties and display properties selected from the group 
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comprising; short text label, description, general entity type, icon reference, 
visual layer settings, priority, status, user comment, certainty value, source of 
information, default + and user-set color, and reference document, and reference 
photograph. . 

27. (original) The method of claim 22, wherein the location data element type 
represents a location within the spatial reference frame. 

28. (original) The method of claim 27, wherein the location data element type 
has data properties and display properties selected from the group comprising; 
position coordinates, a label, description, color information, precision information, 
location type, non-geospatial flag and user comments, reference document, and 
reference photograph. 

29. (Currently amended) The method of claim 28, wherein the location data 
element type is selected from the group comprising; a physical location on a 
geospatial map, a physical location as a node in a diagram, and a virtual location 
related to a geospatial map such that the virtual location is not assigned to a 

specific physical ipgfltton on awsratlal map. 

30. (Currently amended) The method of claim 2d, wherein the at l oact one 
association describes a pairing between two or more of the data elements for 
providing an Information data object related to both of the two or more data 

31 . (Currently amended) The method of claim 30, wherein the connection 
visual element is a eoHd selected line type representing a direct connection 
between the first visual element and the second visual element 

32. (Currently amended) The method of claim 3430. wherein the information 
data object is selected from the group comprising: a communication connection 
describing commMntatiPn ^fet^llg transfer^ tetW53P the two or mpn? fete 
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elements: a financial transaction or other transaction: and a relationship 
connection describing social details in common between the two or more data 
elements, ool i d lino hoc a oointor for indioatlno a vootor property of tho visua l 
oonnoction ele m e nt . 

33. (cancelled) 

34. (Currently amended) The method of claim 2 30, wherein the association is 
predefine pr j§ created dMft \o MSflr intefflflfon with |hQ visya'teaflpn 
representation, further compr l cina tho stop of updating tho vioual olomonte in t he 
visual roproGontat l on i n rosponco to tho ucor ovonta. 

35. (Currently amended) The method of claim 34-1, whoroin tho ucor ovonto 
arc oonomtod in rooponoo to further comprising the step of manipulatinpfeft the 
position of the instant of fo c i on the time tracks for facilitating bv tho ucor of aft 
intoraotlvo oontro l for modifying synchronous modification of the v isual properties 
of the Plurality of visual elements on the time tracks. 

36. (Currently amended) The method of claim 35, wherein synchronous 
modification of the visual properties of the plurality of visual elements includes 
concurrent and continuous updating as the instant of foci are repositioned on the 
time tracks, the Interactive oontrol i e selected from tho group comprising a tim e 
rango colootor and on instant of foouo oo l ootor. 

37. (Currently amended) The method of claim 35 further comprising the step 

of adding at least op? further visual e l ement on apq of the time track? animating 

tho disp l ay of at l oaot ono of tho vicual olomonto of tho vlcuo l roprocontation i n 
response to the manipulation of the instant of foci with respect to a selected time 
ranoe m the temporal reference frame Intoracttvo contro l. 

38. (Currently amended) The method of claim 35 7. whoroin farther comprising 
the step of changing the displayed visual properties of the connection visual 
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element of tho v l oual representa ti on to anlmatod In response to the manipulation 
of the Instant of foci intoractlvo controls , 

39. (Currently amended) The method of claim 38, wherein the connection 
visual element is coupl e d associated with to toe movement of an entity visual 
element across the visual representation between the first location of interest and 
the second location of interest, the entity visual element representing an actor 
involved in a selected event. 

40. (Currently amended) The method of claim 35 further comprising the step 
of applying a filtering function to the visual elements and the at least one related 
association to select a subgroup thereo f, selection of the subgroup according to a 
method selected from the group comprising: criteria matching, algorithmic 
methods, and manual selection . 

41 . (cancelled) 

42. (cancelled) 

43. (Currently amended) A system for creating a multidimensional visual 
representation of a group of data elements having integrated temporal and 
spatial properties, the data elements being included in the visual representation 
as ^corresponding plurality of v isual elements, tho data o l omonto of tho group 
l i nk e d by at least on e assoc i ation, the system comprising: 

a visualization manager for assembling the group of data elements ueto§ 
tho at least ono aoeooiatioo a nd for assigning a connection visual element in the 
visual representation between a first visual element of the plurality of visual 
elements representing a first data element of the group and a second visual 
element of the plurality of visual elements representing a second data element of 
the group; 

a spatial visualization component configured for generating a spatial 

domain of the visual representation to include a reference surface for providing a 
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spatial reference frame having at least two spatial dimensions, the reference 
surface for relating the first visual element to a first location of Interest in the 
spatial reference frame and relating the second visual element to a second 
location of interest in the spatial reference frame; and 

a temporal visualization component configured for generating a temporal 
domain of the visual representation operatively coupled to the spatial domain, the 
temporal domain for providing a common temporal reference frame for the 
locations of interest, the temporal domain Including a first time track coupled to 
the first location of interest and a second time track coupled to the second 
location of interest, the first visual element positioned on the first time track and 
the second visual element positioned on the second time track, each of the time 
tracks extending with rggpept tp frp rflfgrgnfifi SUrfaSS flntf configured for visually 
representing a respective temporal sequence of a plurality of the data elements 
at each of the locations of interest of tho roforonoo ourfaoo ; and 

an interactive control component for positioning a respective instant of 
focus at the intersection region between each of the time tracks and the 
reference surface at the respective locations of interest, the instant of foci being 
used for visually distinguishing a range of past time in the temporal domain 
preceding the instant of foci and a range of future time in the temporal domain 
after the instant of foci, each of the instant of foci configured for synchronous 
repositioning along their respective one of the time tracks: 

wherein the connection visual element represents an a distributed 
association distribtjted in at least one of the domains between the first visual 
element and the second visual element such that the visual representation is 
displayed on a user interface for subsequent interaction with user events. 

44. (Currently amended) A computer program product for creating a 

multidimensional visual representation of a group of data elements having 

integrated temporal and spatial properties, the data elements being included in 

the visual representation as a corresponding plurality of visual elements, tho data 

olomonto of tho group linkod by at loaot ono aooooiation 7 the computer program 

product comprising: 
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a computer readable medium; 

a visualization module stored on the computer readable medium for 
assembling the group of data elements u si ng th e at l oaot ono associat i on and for 
assigning a connection visual element in the visual representation between a first 
visual element of the plurality of visual elements representing a first data element 
of the group and a second visual element of the plurality of visual elements 
representing a second data element of the group; 

a spatial visualization module stored on the computer readable medium 
for generating a spatial domain of the visual representation to include a reference 
surface for providing a spatial reference frame having at least two spatial 
dimensions, the reference surface for relating the first visual element to a first 
location of interest in the spatial reference frame and relating the second visual 
element to a second location of interest in the spatial reference frame; and 

a temporal visualization module stored on the computer readable medium 
for generating a temporal domain of the visual representation operatively coupled 
to the spatial domain, the temporal domain for providing a common temporal 
reference frame for the locations of interest, the temporal domain including a first 
time track coupled to the first location of interest and a second time track coupled 
to the second location of interest, the first visual element positioned on the first 
time track and the second visual element positioned on the second time track, 
each of the time tracks extending with respect to the reference surface and 
configured for visually representing a respective temporal sequence of a plurality 
of the data elements at each of the locations of interest of the r e f e ronoo eurfaoo ; 
and 

an interactive control component for positioning a respective instant of 
focus at the intersection region between each of the time tracks and the 
reference surface at the respective locations of interest, the instant of foci being 
used for visually distinguishing a ranee of oast time In the temporal domain 
preceding the instant of foci and a range of future time in the temporal domain 
after the instant of foci, each of the instant of foci configured for synchronous 
repositioning along their respective one of the time tracks: 
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wherein the connection visual element represents €t an dtotributod 
association distributed in at least one of the domains between the first visual 
element and the second visual element such that the visual representation is 
displayed on a user interface for subsequent Interaction with user events. 

45. (new) The method of claim 4 further comprising the step of specifying the 
range of past time independently from the range of future time. 

46. (new) The method of claim 4 further comprising the step of specifying the 
range of past time and the range of future time independently from the Instant of 
foci. 

47. (new) The method of claim 5 further comprising the step of configuring a 
visual translucency of the reference surface in order to facilitate showing the time 
tracks extending below and above the reference surface. 

48. (new) The method of claim 8 y wherein the visual elements positioned on 
the time tracks are icons. 

49. (new) The method of daim 29 further comprising the step of positioning 
the virtual location at an edge of the geospatial map in the spatial reference 
frame. 

50. (new) The method of claim 35 further comprising the step of removing at 
least one of the plurality of visual elements from at least one of the time tracks in 
response to the manipulation of the instant of foci with respect to a selected time 
range in the temporal reference frame. 

51 . (new) The method of claim 35 further comprising the step of removing one 
of the time tracks and the respective visual elements positioned thereon from the 
visualization representation in response to the respective visual elements 
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becoming outside of a selected time range in the temporal reference frame in 
response to the repositioning of the Instant of foci. 

52. (new) The method of claim 35 further comprising the step of reassigning 
associated ones of the visual elements from the range of past time of the time 
tracks on one side of the reference surface to the range of future time of the time 
tracks on the other side of the reference surface in response to manipulation of 
the position of the instant of foci. 

53. (new) The method of claim 52 further comprising the step of positioning 
selected ones of the visual elements on the reference surface associated with 
ones of the data elements having a present time in the temporal reference frame 
corresponding to the time represented by the instant of foci. 

54. (new) The method of claim 52 further comprising the step of positioning 
selected ones of the visual elements above the reference surface associated with 
ones of the data elements having a present time In the temporal reference frame 
corresponding to the time represented by the instant of foci. 

55. (new) The method of claim 53, wherein the position of each of the 
selected visual elements is selected from the group comprising: at the location of 
interests; and interpolated between the location of interests. 

56. (new) The method of claim 53 further comprising the step of animating the 
change in position of each of the selected visual elements on the reference 
surface as the positions of the instant of foci are manipulated, such that the 
visual properties of the plurality of visual elements in the visualization 
representation are updated in both the temporal and spatial domains. 

57. (new) A system for creating a multidimensional visual representation of a 
group of data elements having integrated temporal and spatial properties, the 
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data elements being included in the visual representation as a corresponding 
plurality of visual elements, the system comprising: 

a visualization manager for assembling the group of data elements 
including a first data element represented by a first visual element of the plurality 
of visual elements and a second data element represented by a second visual 
element of the plurality of visual elements; 

a spatial visualization component configured for generating a spatial 
domain of the visual representation to include a reference surface for providing a 
spatial reference frame having at least two spatial dimensions, the reference 
surface for relating the first visual element to a first location of interest in the 
spatial reference frame and relating the second visual element to a second 
location of interest in the spatial reference frame; 

a temporal visualization component configured for generating a temporal 
domain of the visual representation operativeiy coupled to the spatial domain, the 
temporal domain for providing a common temporal reference frame for the 
locations of interest the temporal domain including a first time track coupled to 
the first location of interest and a second time track coupled to the second 
location of interest, the first visual element positioned on the first time track and 
the second visual element positioned on the second time track, each of the time 
tracks extending with respect to the reference surface and configured for visually 
representing a respective temporal sequence of a plurality of the data elements 
at each of the locations of interest; and 

an interactive control component for positioning a respective instant of 
focus at the intersection region between each of the time tracks and the 
reference surface at the respective locations of Interest the instant of foci being 
used for visually distinguishing a range of past time in the temporal domain 
preceding the instant of foci and a range of future time in the temporal domain 
after the Instant of foci, each of the instant of foci configured for synchronous 
repositioning along their respective one of the time tracks; 

wherein the visual representation is displayed on a user interface for 
subsequent interaction with user events. 



Gowllng Lafleur Henderson LLP Page 17 

T8468092US\TOfl_LAWV 63391 50V1 

18/31 * RCVD AT 6/29/2006 1:55:19 PM [Eastern Daylight Time] • BVR:USPTO-EFXRF<5/22 * DNIS:2738300 * CSID:Cowtlngs Toronto #18 • DURATION (mm-*s):11-34 



Gowlings Toronto tt!8 6/29/2006 1:55 PAGE 019/031 Fax Server 



Appl. No. 10/810.680 

AmdL dated June 29, 2006 

Reply id Office Action of January 26. 2006 

58. (new) The system of claim 57, wherein the visual representation of the 
group of data elements is selected from the group comprising; a concurrent time 
and geographic context and a concurrent time and diagrammatic context. 

59. (new) The system of claim 58, wherein the diagrammatic context includes 
a plurality of nodes of a defined process, such that one of the nodes is positioned 
at the first location of interest and a second one of the nodes is positioned at the 
second location of interest. 

60. (new) The system of claim 59 further comprising a time range indicator of 
the temporal reference frame for specifying a range selected from the group 
comprising: the range of past time of the temporal sequence preceding the 
instant of focus; and the range of future time of the temporal sequence after the 
instant of focus. 

61 . (new) The system of claim 4 further comprising a time range indicator of 
the temporal reference frame for specifying the range of past time independently 
from the range of future time. 

62. (new) The system of claim 4 further comprising a time range indicator of 
the temporal reference frame for specifying the range of past time and the range 
of future time independently from the instant of foci. 

63. (new) The system of claim 57, wherein the plurality of the visual elements 
are arranged along the time tracks according to the times at which the 
corresponding data elements occurred in the temporal reference frame, at least 
one of the plurality of the visual elements being independent and as such being 
not related to either of the first and second visual elements. 

64. (new) The system of claim 57, wherein the location data element type is 

selected from the group comprising; a physical location on a geospatial map, a 

physical location as a node in a diagram, and a virtual location related to a 
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geospatial map such that the virtual location is not assigned to a specific physical 
location on the geospatial map. 

65. (new) The system of claim 64, wherein the virtual location is positioned at 
an edge of the geospatial map In the spatial reference frame. 

66. (new) The system of claim 58, wherein an association describes a pairing 
between two or more of the data elements for providing an information data 
object related to both of the two or more data elements. 

67. (new) The system of claim 66, wherein the information data object is 
selected from the group comprising: a communication connection describing 
communication details transferred between the two or more data elements; a 
financial transaction or other transaction; and a relationship connection 
describing social details in common between the two or more data elements. 

68. (new) The system of claim 57, wherein the position of the instant of foci is 
configured for manipulation on the time tracks for facilitating synchronous 
modification of the visual properties of the plurality of visual elements on the time 
tracks. 

69. (new) The system of claim 68, wherein synchronous modification of the 
visual properties of the plurality of visual elements includes concurrent and 
continuous updating as the instant of foci are repositioned on the time tracks. 

70. (new) The system of claim 68, wherein the visualization manager is further 
configured for adding at least one further visual element on one of the time tracks 
in response to the manipulation of the instant of foci with respect to a selected 
time range In the temporal reference frame. 

71 . (new) The system of claim, wherein the visualization manager is further 
configured for removing at least one of the plurality of visual elements from at 
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least one of the time tracks in response to the manipulation of the instant of foci 
with respect to a selected time range in the temporal reference frame. 

72. (new) The system of claim 68, wherein the visualization manager is further 
configured for removing one of the time tracks and the respective visual elements 
positioned thereon from the visualization representation in response to the 
respective visual elements becoming outside of a selected time range in the 
temporal reference frame in response to the repositioning of the instant of foci. 

73. (new) The system of claim, wherein the visualization manager is further 
configured for reassigning associated ones of the visual elements from the range 
of past time of the time tracks on one side of the reference surface to the range 
of future time of the time tracks on the other side of the reference surface in 
response to manipulation of the position of the instant of foci. 

74. (new) The system of claim 73, wherein the visualization manager is further 
configured for positioning selected ones of the visual elements on the reference 
surface associated with ones of the data elements having a present time in the 
temporal reference frame corresponding to the time represented by the instant of 
foci. 

75. (new) The system of claim 73, wherein the visualization manager is further 
configured for positioning selected ones of the visual elements above the 
reference surface associated with ones of the data elements having a present 
time in the temporal reference frame corresponding to the time represented by 
the Instant of foci. 

76. (new) The system of claim 74, wherein the position of each of the selected 
visual elements is selected from the group comprising: at the location of 
interests; and interpolated between the location of interests. 
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77. (new) The system of claim 74, wherein the visualization manager is further 
configured for animating the change in position of each of the selected visual 
elements on the reference surface as the positions of the instant of foci are 
manipulated, such that the visual properties of the plurality of visual elements in 
the visualization representation are updated in both the temporal and spatial 
domains. 

78. (new) The system of claim 68, wherein the visualization manager is further 
configured for changing the displayed visual properties of the connection visual 
element in response to the manipulation of the instant of foci . 

79. (new) The system of claim 78, wherein the connection visual element is 
associated with movement of an entity visual element across the visual 
representation between the first location of interest and the second location of 
interest, the entity visual element representing an actor involved in a selected 
event. 

80. (new) The system of claim 68, a filtering function is applicable to the visual 
elements and the at least one related association to select a subgroup thereof, 
selection of the subgroup according to a method selected from the group 
comprising; criteria matching, algorithmic methods, and manual selection* 
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